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ABSTRACT 



A system for collecting user feedback in a data broadcasting 
system, the system for collecting user feedback including a 
multiplicity of user profile agents, each user profile agent 
being associated with one of a multiplicity of users of the 
data broadcasting system aod being operative to create a 
user profile based on activity of the one user, a user profile 
subsystem associated with a plurality of user profile agents 
chosen from among the multiplicity of user profile agents 
and operative to derive an integrated user profile based on 
the plurality of user profiles created by the plurality of user 
profile agents, and a broadcasting agent operatively associ- 
ated with a broadcast center of the data broadcasting system 
and in operative communication with the user profile sub- 
system and receiving therefrom the integrated user profile. 

24 Claims, 5 Drawing Sheets 
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FIG. 4 
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APPARATUS AND METHOD FOR AGENT- 
BASED FEEDBACK COLLECTION IN A 
DATA BROADCASTING NETWORK 

FIELD OF THE INVENTION 5 

The present invention relates to broadcast systems in 
general, and in particular to systems for collecting user 
feedback in a broadcast system, especially in a data broad- 
cast system where feedback may be used for determining the 
content of future broadcasts. 

BACKGROUND OF THE INVENTION 

Data broadcasting systems have been proposed as a good 
solution for delivering data to customers while avoiding 15 
known problems associated with the Internet In a typical 
data broadcasting system a single broadcast entity broad- 
casts information to a multiplicity of users, each user typi- 
cally associated with a personal computer, a mobile 
computer, an interactive television, a band-held communi- 2 q 
cation device such as a beeper or a cellular or mobile 
telephone, or a similar device. Each user may receive those 
broadcast items which the user wishes to receive. Typically 
but not always, each broadcast item comprises a multimedia 
item. 25 

It is generally recognized that it would be desirable to 
obtain user feedback at the broadcast entity, the user feed- 
back typically comprising information about types of infor- 
mation which each user would like to receive. However, 
because of the multiplicity of users it would apparently be 30 
inefficient and awkward to receive individual feedback from 
each user. 

One system for scheduling broadcasts using customer 
profiles is described in U.S. Pat No. 5,758,257 to Herz et al. 
The Herz et al patent describes scheduling the receipt of 35 
desired movies or other forms of data by means of individual 
customer profiles describing each individual customer. A 
so-called "agreement matrix" is calculated by comparing the 
recipient's profiles to the actual profiles of the available 
programs or other data. A virtual channel for each individual 40 
is generated from the "agreement matrix", in an attempt to 
satisfy the desires of each individual via tbeir own virtual 
channel. 

PCT patent application PCT/IL98/00307 describes an 
electronic program guide system using an intelligent agent 45 
in which the electronic program guide may be customized 
based on user behavior. 

The following references provide a sample of the state of 
the art, and are useful in understanding the present inven- 
tion: 

1. S. Acharya, M. Franklin and S. Zdonik 1996. Dissemi- 
nating updates on broadcast disks. Proceedings of the 
22nd VLDB Conference, Mumbai (BombayX India. 

2. S. Acharya, R. Alonso, M J. Franklin, and S. B. 55 
Zdonik. 1995. Broadcast disks: Data management for 
asymmetric communications environments. In M. J. 
Carey and D. A. Schneider, editors, Proceedings of the 
1995 ACM SIGMOD International Conference on 
Management of Data, pages 199-210, San Jose, Calif., 60 
1995. SIGMOD Record 24(2). 

3. W P. Birmingham, E. H. Durfee, T. Mullen, and M. P. 
Wellman. 1995. The distributed agent architecture of 
the University of Michigan Digital Library (UMDL). In 
Spring Symposium Series on Software Agent. 65 

4. E. Bloedorn, I. Mani and T. R. MacMillan. 1996. 
Representational issues in machine learning of user 



\2 Bl 

2 

profiles. AAAI Spring Symposium on Machine Learning 
in Information Access, 

5. E. W. Brown, J. P. Callan, B. Croft. 1994. Fast 
incremental indexing for full-text information retrieval. 
Proceedings of VLDB Conf } pages 192-202. 

6. cc: Browser. 1997. bttp://www.f auflcner.com/ 

7. S. D. Cohen and L. J. Guibas. 1996. Shape-based 
illustration indexing and retrieval some first steps Stan- 
ford University, Stanford, ARfi\ Image Understanding 
Workshop 1996. 

8. CNN++ News filtering Agent. 

9. D. Cutting and J. Pederson. 1990. Optimizations for 
dynamic inverted index maintenance. Proceedings of 
SIGIR, pages 405-411. 

10. Y. Ejgenberg and Y. Lindel. 1997. B.S.c project, 
Computer Science Department at Bar Ban University. 

11. P. Edwards, D. Bayer, C. L. Green and T. R. Payne. 
1996. Experience with learning agents which manage 
Internet-based information. AAAI Spring Symposium 
on Machine learning in IA, Scotland. 

12. C. Faloutsos and D. W. Oard. 1995. A survey of 
information retrieval and filtering methods. University 
of Maryland CS-TR-3514. 

13. W. B. Frakes and R. Baeza-Yates. 1992. Information 
Retrieval: Data Structures & Algorithms, Prentice Hall 
Englewood Cliffs, N J. 

14. K. C. Gowda and G. Krishna. 1978. Agglomerative 
clustering using the concept of mutual nearest neigh- 
bourhood. Pattern Recognition, Vol. 10, No 2, pp. 
105-112 

15. S. Gant. WEbFilten An agent for filtering the Web. 
http ://ils.unc.edu/webfilter/. 

16. D. E. Goldberg. 1989. Genetic Algorithm in Search, 
Optimization and Machine Learning. Addison-Wesley. 

17. T. Imielinski, S. Viswanathan. 1994. Adaptive wire- 
less information systems. In Proceedings of GIG DBS 
Conference, Tokyo, Japan. 

18. 1. I. Ink and N. McGough. 1992. Robots and mail 
filtering httpr/Avww.ii.com/intcrnet/robots/. 

19. A. Kobsa. 1994. User modeling and user-adapted 
interaction. In Proceedings of ACM CHI "94 Confer- 
ence on Human Factors in Computing Systems, Vol- 
ume 2 of TUTORIALS, pages 415-416. 

20. K. Lang. 1995. News Weeder: Learning to filter 
netnews. Proceedings of INT Conference of Machine 
Learning, PP 331-339. 

21. W. Y Ma and B. S. Manjunath. 1995. Image indexing 
using a texture dictionary. Proceedings of SPIE Con- 
ference on Image Storage and Archiving System, Vol. 
2606, pp. 288-298. Philadelphia Pa. 

22. P. Maes and R. Kozicrok 1993. Learning interface 
agents. Proceedings ofAAAI-93 Washington D.C. pp. 
459^65. 

23. B. S. Manjunath and W. Y Ma. 1996. Texture features 
for browsing and retrieval of image data. IEEE T-PAM1 
special issue on Digital Libraries. 

24. A Moukas. 1996. Amalthaea: Information discovery 
and filtering using a multi-agent evolving ecosystem. 
The first international conference on the Practical 
Application of Intelligent Agents and Multi Agents 
Technology, pp. 421^36. 

25. S. J. Pelletier and J. F. Arcand. 1996. STEALTH: A 
personal digital assistant for information filtering. The 
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first international conference on the Practical Appli- SUMMARY OF THE INVENTION 
cation of Intelligent Agents and Mulii Agents Technol- 

ogy pp 455-474 present invention seeks to provide an improved 

26. E. Rasmussen.1992. Information Retrieval Data f ? r P^ting feedback in a broadcast system, par- 
Structures and Algorithms. Editors: W. B. Frakes and 5 Ocularly m a data broadcast system. In the present in venUon 
R. Baeza-Yates Prentice HaU Inc., Englewood Cliffs, a USCT P rofile subsystem, preferably comprising a hierarchy 
NJ. of cooperating agents, is used to collect and aggregate user 

27. P. Resnick, N. Iacovou, M. Suchak, P. Bergstrom and feedback for delivery to a broadcaster. Preferably, the broad- 
J. Riedh 1994. GroupLens: An open architecture for c *s te r uses the user feedback for determining the content of 
collaborative filtering of netnews. Proceeding of ACM 10 future broadcasts. 

CSCW 94 Conference on Computer Supporter Coop- There is thus provided in accordance with a preferred 

erative Work. pp. 175-186. embodiment of the present invention a system for collecting 

28. C. J. Van Rijsbergen. 1979. Information Retrieval- user feedback in a data broadcasting system, the system for 
Second Edition Butterworth & Co (Publisher) LTD. collecting user feedback including a multiplicity of user 

29. G. Salton. and M. J. McGill. 1983. Introduction to J5 profile agents, each user profile agent being associated with 
Modern Information Retrieval, McGraw-Hill. one of a multiplicity of users of the data broadcasting system 

30. U. Shardanand and R Macs. 1995. Social information and being operative to create a user profile based on activity 
filtering: Algorithms for automating ''Word of Mouth**. of the one user, a user profile subsystem associated with a 
ACM CW95 MOSAIC OF CREATIVITY, pages plurality of user profile agents chosen from among the 
210-217. ^ multiplicity of user profile agents and operative to derive an 

31. B. D. Sheth. 1994. A Learning Approach to Person- integrated user profile based on the plurality of user profiles 
alized Information Filtering. Master's thesis, MIT created by the plurality of user profile agents, and a broad- 
Media Lab. casting agent operative ly associated with a broadcast center 

32. Study Group on Broadcasting System in the Multi- of the data broadcasting system and in operative communi- 
media Age (SGBSMA). 1995. Report by the Study 25 cation with the user profile subsystem and receiving there- 
Group on Broadcasting System in the Multimedia Age. from the integrated user profile. 

Ministry of Posts and Telecommunication (MPT) of Further in accordance with a preferred embodiment of the 

Japan, Press Release. Http://www.mpt .go.jp/Report/ present invention the user profile subsystem includes a 

Broadtastmg-system/press-release.html. plurality of clustering agents, each clustering agent being 

33. L. Terveen, W. Hill, B. Amento, D. MacDonald, and 30 operatively associated with a subset of user profile agents 
J. Oreter. 1997. PHOAKS: A system for Sharing rec- chosen from among the plurality of user profile agents and 
ommendations. Communication of the ACM, vol.40, being operative to derive a preliminary community profile 
no. 3, pages 59-62. based on the plurality of user profiles created by the subset 

34. Universal Browser for Listening. 1997. http:// of user profile agents. 

www.austinre.co m/c^i/browser.cgL 35 still further in accordance with a preferred embodiment of 

35. J. Vassileva. 1994. A practical architecture for user the present invention the system also includes at least one 
modeling in a hypermedia-based information system. union set agent in operative communication with at least two 
In Proceedings of the 4 th International Conference on of the plurality of clustering agents and operative to coor- 
user Modeling, pages 115-120. MITRE Corporation. dinate the operation of the at least two clustering agents. 

36. J. M. Vidal and E. Durfee. 1995. Task planing agent «0 Additionally in accordance with a preferred embodiment 
in the UMDL. In Proceedings of die 1995 Intelligent 0 f the present invention the union set agent is operative to 
Information Agents Workshop. coordinate the operation of the at least two clustering agents 

37. Video On Line. 1995. http://www.vol.it/VOLB/ by coordinating at least one characteristic of the preliminary 
browser.html. community profile derived by the clustering agents. 

38. W. Wahlster. 1994. Toward personalized multimedia. 45 Moreover in accordance with a preferred embodiment of 
In ^Proceedings of the 4 th International Conference on mc prcscnt invention the system also includes a community 
User Modeling, pages 3-4. MITRE Corporation. profile agent operative to derive a community profile from 

39. D. Walley. 1996a. Data broadcasting vs. conventional the preliminary community profile. 

on-line services. Hup://www.mbnetmb.ca/~walleydc/ ^ Further m accordancc ^ a preferred embodiment of the 

advanta.html. present invention the integrated user profile includes at least 

40. D. Walley. 1996b. Free commercial mass-audience onc community profile. 

datacasting of popular information and software direct ^ fe ^ pf0vided m acoordance ^ mother pre- 

to personal computers. ferred embodiment of me preseDt invention a method for 

41. Http://ww.mbnet.mb.ca/~walleydcAnt_mtriitml. 5S coUeding user feedback in a data broadcasting system, the 

42. A. White and R. Jain. 1996. Algorithm and strategies method including providing a multiplicity of user profile 
for similarity retrieval. University of California, San agents, each user profile agent being associated with one of 
Diego- a multiplicity of users of the data broadcasting system, 

43. Bruce Krulwich, 1997; Lifestyle Finder, Intelligent creating, using a plurality of user profile agents from among 
user profiling using large scale demographic data. so the multiplicity of user profile agents, a plurality of user 

44. G. Paliouras, C. Papatheodorou, V. Karkaletsis, C. profiles based on activity of a plurality of users, deriving, 
Spyropoulos, and V. Malaveta; "Learning user commu- using a user profile subsystem associated with a plurality of 
nities for improving the services of information pro- user profile agents chosen from among the multiplicity of 
viders". user profile agents, an integrated user profile based on the 

The disclosures of all references mentioned above and 65 plurality of user profiles created by the plurality of user 

throughout the present specification are hereby incorporated profile agents, and utilizing a broadcasting agent operatively 

herein by reference. associated with a broadcast center of the data broadcasting 
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system and in operative communication with the user profile 
subsystem and receiving therefrom the integrated user pro- 
file. 

Further in accordance with a preferred embodiment of the 
present invention the user profile subsystem includes a 
plurality of clustering agents, each clustering agent being 
operatively associated with a subset of user profile agents 
chosen from among the plurality of user profile agents, and 
the deriving step includes deriving the integrated user profile 
based on the plurality of user profiles created by the subset 
of user profile agents. 

Still further in accordance with a preferred embodiment of 
the present invention the deriving step also includes coor- 
dinating the operation of at least two of the plurality of 
clustering agents using at least one union set agent in 
operative communication with at least two of the plurality of 
clustering agents. 

Additionally in accordance with a preferred embodiment 
of the present invention the method also includes the union 
set agent coordinating the operation of the at least two 
clustering agents by coordinating at least one characteristic 
of a preliminary community profile derived by the clustering 
agents. 

Moreover in accordance with a preferred embodiment of 
the present invention the integrated user profile includes at 
least one community profile. 

Further in accordance with a preferred embodiment of the 
present invention the deriving step includes a community 
profile agent deriving the at least one community profile 
from a preliminary community profile. 

Still further in accordance with a preferred embodiment of 
the present invention the utilizing step includes modifying at 
least one broadcast program based, at least in part, on the 
integrated user profile. 

Additionally in accordance with a preferred embodiment 
of the present invention the modifying includes assigning, to 
a program associated with a first community, items sched- 
uled to be broadcast according to a program associated with 
a second community. 

Moreover in accordance with a preferred embodiment of 
the present invention the assigning includes assigning based 
on a measure of relevancy to the first community. 

There is also provided in accordance with another pre- 
ferred embodiment of the present invention a method for 
collecting user feedback in a data broadcasting system, the 
method including deriving a user profile for each of a 
multiplicity of data item users, clustering user profile infor- 
mation from at least some of the multiplicity of data item 
users to produce preliminary community information, modi- 
fying the preliminary community information to produce 
community information, and utilizing the community infor- 
mation for modifying a broadcast schedule. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will be understood and appreciated 
more fully from the following detailed description, taken in 
conjunction with the drawings in which: 

FIG. 1 is a simplified pictorial illustration of an agent- 
based user feedback collection system constructed and 
operative in accordance with a preferred embodiment of the 
present invention; 

FIG. 2 is a simplified flowchart illustration of a preferred 
method of operation of the system of FIG. 1; 

FIG. 3 is a simplified pictorial illustration of a preferred 
embodiment of a user profile, useful in understanding the 
method of FIG. 2; 
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FIG. 4 is a simplified pictorial representation of a multi- 
media document representation, useful in understanding the 
method of FIG. 2; and 

FIG. 5 is a simplified flowchart illustration of a preferred 
5 method of operation of a portion of step 200 of FIG. 2. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

Reference is now made to FIG. 1 which is a simplified 

10 pictorial illustration of an agent-based user feedback collec- 
tion system constructed and operative in accordance with a 
preferred embodiment of the present invention. The system 
of FIG. 1 comprises a plurality of user stations 100, each of 
the plurality of user stations 100 being operatively associ- 

15 ated with a user profile agent 110. It is appreciated that, 
typically, a multiplicity of user stations 100, such as, for 
example, 1 million or more user stations 100, is provided, a 
plurality of user stations 100 being shown in FIG. 1 for sake 
of simplicity of description. It is also appreciated, as also 

20 described below, that other agents (not shown) in addition to 
the user profile agent 110, may also be operatively associ- 
ated with each of the plurality of user stations 100. 

Each of the user stations 100 preferably comprises an 

^ appropriate computing system, such as a multimedia com- 
puting system as is well-known in the art, equipped and 
operative to receive broadcasts, typically comprising mul- 
timedia data broadcasts, from a broadcast center 120. It is 
appreciated, as is well known in the art, that the broadcast 

?0 center 120 may broadcast using any one or more of a variety 
of appropriate broadcast methods, including conventional 
terrestrial broadcast, digital terrestrial broadcast, satellite 
broadcast, cable broadcast, or any other appropriate broad- 
cast method. It is further appreciated that each user station 

}S 100 is preferably equipped to receive broadcasts of a type 
broadcast by the broadcast center 120. 

Each of the user profile agents 110 is preferably imple- 
mented in a combination of computing hardware and 
software, as is well known in the art, and is preferably 

w operative to observe the behavior of a user of the associated 
user station 100 and to create a user profile, as described 
more fully below, characterizing the preferences of the user 
of the associated user station 100. 

The system of FIG. 1 also comprises a user profile 

45 subsystem 130. The user profile subsystem 130 is preferably 
implemented in an appropriate combination of computing 
hardware and software, as is well known in the art, and is 
typically located remotely from each of the user stations 
100, and in operative communication therewith. The user 

50 profile subsystem 130 is operative to receive a user profile 
from each of the user profile agents 110, to analyze the 
received profiles, and to derive therefrom a plurality of 
community profiles characterizing the multiplicity of user 
stations 100 in accordance with a plurality of communities, 

55 each community preferably sharing a set of preferences and 
characteristics. Typically, the user profile subsystem 130 
produces an output comprising community information, 
preferably in the form of a plurality of community profiles 
each characterizing one community. 

60 The user profile subsystem 130 typically comprises a 
plurality of agents, as described below. The plurality of 
agents comprised within the user profile subsystem 130 may, 
when referred to generally, be referred to as "integrated user 
profile agents". For simplicity of description, the integrated 

65 user profile agents are collectively referred to herein as the 
"user profile subsystem 130", it being appreciated that, 
because of possible separate implementation and possible 
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geographic dispersal of the integrated user profile agents, the criteria determined by the filter agent, by other agents, or 

term "user profile subsystem 130" is itself a term which has otherwise, particularly as described below. 

been adopted mainly for the sake of simplicity of descrip- ^ ^ agem m fe preferably operadve , „ 

uon ' described more fully below, to create a user profile describ- 

The user profile subsystem 130 typically comprises a 5 mg me { tem -selectiorj preferences of the user of the associ- 

plurality of clustering agents 140, each clustering agent 140 atc d user unit 100. Each user profile agent 110 then passes 

being operatively associated with a subset of the user 0D the user profile to the user profile subsystem 130, 

stations 100 and preferably being operative to produce one specifically to one of the clustering agents 140. Each clus- 

or more preliminary community profiles based on informa- agent 140 is preferably operative, as described more 

tion received from the associated user profile agents 110 10 frilly below, to cluster information from a plurality of user 

associated with each of the user stations 100 in the subset of profiles and to create therefrom community profile 

the user stations 100. information, representing a clustered aggregate of informa- 

The user profile subsystem 130 also typically comprises at tion about preferences of a plurality of users, 

least one union set agent 150. The union set agent 150 is ftefenbly, ^ union set agent 150 is operative, as 

preferably operative to cooperate with a plurality of clus- described more my below> to coordinate the activities of 

tenng agents 140 and to adjust the operation thereof m such me clusterin ^ 140 m order t0 mat mifonB 

a way that community ^formation i produced by each clus- community profile information, representing clustered infor- 

tenng agent 140 is compatible with, and tends to form the mation across ^ of me ^ units 100 , k produced . C om- 

same communities as that produced by each other clustering munit m f onna ti on fam a plmal n y of clustering agents 140 

agent 140. Specifically, and without limiting the generality b men , icaU aggregatcd ^ a community profile for 

of the foregoing, the union set agent 150 is preferably cach community by onc or m ore community agents 155, 

operative to examine community profiles produced by a each community agent 155 preferably being associated with 

plurality of clustering agents ; 140, to idenhfy similar com- Qne community profile. The community information, typi- 

munity profiles produced by different clustering agents 140, cd] m ^ fofm of ^ community profiles, is then passed 

10 ^ tb ^, Sim ' U , r COm T^ t ^ P I°5 eS ' "J* 10 rep0rt on the broadcasting agent 160, where it is used as input in 

unified profiles back to each of the different clustermg agents broadcast decisions of the broadcast center 120, including 

140 so that the difierent clustering agents 140 wUl operate dedsions ^ tQ ^ of broadcasts . 
with the same community profiles. 

The system of FIG. 1 also comprises at least one com- w „ Re f eren « * now made to FlG. 2, which is a simplified 

munity agent 155, typically comprising a plurality of com- 30 fl ° wchlrt ^ r ' tl ° n , of "1 P refen f d ' of operUion of 

munity agents isi Each community ajnt 155 is preferably te svstem ° f ™- »■ ^ mcthod ° f nG 2 P refcrablv 

associated with one community profile produced by one or comprises the following steps: 

more clustering agents 140 as described above, and is A user profile is derived for each user of a multiplicity of 

preferably operative to aggregate information relating to the 35 data item users (step 170). It is appreciated that a wide 

one community profile as reported by the one or more variety of different methods, including methods known in 

clustering agents 140. the art, may be used to derive a user profile, and that a user 

The system of FIG. 1 also comprises a broadcasting agent profile may have any one of a wide variety of structures, 

160, which is typically implemented in an appropriate including structures which are well known in the art. It is 

combination of computer hardware and software. The 40 further appreciated that not every user need have exactly the 

broadcasting agent 160 preferably receives the community same user profile structure as every other user, 

information produced by the user profile subsystem 130 and Reference is now additionally made to FIG. 3, which is a 

is preferably operative, based on the received community simplified pictorial illustration of a preferred embodiment of 

information, to modify the operation of the broadcast center a ^ profilej ^ understanding the method of FIG. 2. 

120 to take into account community preference information 45 In the example user profile of FIG. 3, a profile is depicted as 

comprised in the community information. By way of a treCj m which ^ch level repr esents a different level of 

example only and without limiting the generality of the information about user preferences, each node in the tree 

foregoing, modifying the operation of the broadcast center being represented as a vector, the sum of whose component 

120 may include modifying the content of future broadcasts. values ^ 1Q Rc f crcacc is now additionally made to FIG. 4, 

The operation of the apparatus of FIG. 1 is now briefly 50 which is a simplified pictorial representation of a multimedia 

described. The broadcast center 120 broadcasts a plurality of document representation, useful in understanding the 

broadcast items to the multiplicity of user units 100. The method of FIG. 2. It is appreciated that the example docu- 

user of each user unit 100 elects to receive one or more merit representation of FIG. 4 is generally compatible with 

broadcast items; it is appreciated that, in some cases, a user the example user profile of FIG. 3. 

may elect not to receive any items. It is appreciated, as is 55 „ - . , . . r . . r r 

,, , - . ... \ , , . • ^ Referring back to FIG. 2, user profile information from at 

well known in the art, that a user may elect to receive a . . ff • . 

. , - * ♦ u • u <u least some of the multiplicity of data item users is clustered 

broadcast item using any appropriate technique, such as, for . . ,. . - c 

example: the user may sekct an individual item or a group 0 P"**" 06 , Preliminary community information 

of items in advance; the user may select an individual item ( ste P 18 °>- ™ e c,ust f k n °f J? « e P may use any appro- 

or a group of items on demand; the user may program the 60 P na 'f Mustering method for combining together smula, 

user unit 100 to select a particular item, an item matching P 10 "* ***** ■ « appropriate clustermg method may 

• ... . . . be chosen from the field of mfonnation retrieval technology. 

certain criteria, or an item broadcast at a particular time; or 7 " " . , " ^uiau^u.. <" . "'"a/. 

any appropriate combination of the above, including a W1 * U,B addm ° nal fea ^ re mat more i one level f 

combinauon with other techniques well known in the art. It P rofi ^ ""^ ^ ° D ? CXamP 

is also appreciated that a filter agent (not shown) may 65 profile of FIG. 3, is used for clustermg. 

automatically download, accept, or record only those items Clustering of user profiles preferably is based on similar- 

which are deemed to be of interest to the user based on ity between user profiles. Similarity between two user 
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profiles, based on user classes and subclasses, may prefer- 
ably be computed in accordance with the following formula: 

similarity userl, user2) = 

user 1 _c las si • user 1 _$ubcla$ sij x 
c s 

user2_cbssi- user2_subclassij 

£ £ (userl_clflssi* user 1 _subciassij) 2 ■ 
c s 

i n (user2 cbssi user2_$ubclassij) 2 

J C Si 

where userl and user2 are class vectors of two user profiles, 
each user profile having a plurality of subclasses, C being 
the number of classes and Si the corresponding number of 
subclasses. It is appreciated that the above formula com- 
prises one example of a suitable formula, and that other 
formulas may be used. 

Preferably, clustering is carried out using an appropriate 
agglomerative clustering method, as is well known in the art. 
One example of an appropriate method for clustering is as 
follows: 

0. Identify each user profile as a point in the space to be 
merged. 

1. Initialize each point as a cluster. 

2. Find the two closest clusters in the space and merge 
them together. 

3. Compute the distance from the newly formed cluster to 
all other clusters. 

4. If more than one cluster remains, return to step 2. 
Typically, a method such as that described above outputs 

a complete binary tree wherein each internal node of the tree 
represents a merge between two cluster and the leaves are 
the points in the space, or user profiles. Typically, the lower 
levels in the tree are small tight clusters while the higher 
levels are larger, general clusters. The indicated method, 
which operates on the available data and is not limited by 
external parameters, is considered, based on the work of the 
inventors of the present invention, to be preferred in the 
present invention. 

In the method described above, a measure of closeness or 
distance is important in determining which clusters to 
merge. A number of ways of determining distance are well 
known in the art In the present invention, it is believed to 
be preferred to use a "complete link" method, in which the 
distance between two clusters is the distance between their 
two furthest points. This method is believed likely to pro- 
duce bound clusters, as opposed to long, "straggly" clusters. 

An approach to expressing the method described above is 
to use the Lance Williams dissimilarity update formula, 
which is well-known in the art The formula enables incre- 
mental recalculation of cluster distances. The Lance- 
Williams dissimilarity update formula is given as follows: 

d(cij,cky<xi^ci,ck}^d(^ 

where, for the preferred case of complete link, the following 
parameters are preferably used: 

ai-a/2 

The preliminary community information is modified to 
produce community information (step 190). Referring back 
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to FIG. 1, it is appreciated that each clustering agent 140 is 
operative to produce preliminary community information 
relating to a plurality of associated user stations 100, which 
plurality of associated user stations 100 is generally disjoint 

5 from each other plurality of user stations 100 associated with 
another clustering agent 140. For reasons of efficiency, it is 
desirable nonetheless for the preliminary community infor- 
mation produced by each clustering agent 140 to be modi- 

10 fied and made uniform with community information pro- 
duced by other clustering agents 140. Preferably, the union 
set agent ISO is primarily operative to carry out step 190, 
with final agglomeration at the community level being 
carried out by the community agent 155, as described above. 

15 Referring back to FIG. 2, in step 190, preferably prelimi- 
nary community information, preferably in the form of 
preliminary community profiles produced by a plurality of 
clustering agents, is unified preferably using methods simi- 

20 lar to those described above for user profiles in step 180. 
Preferably, as described above with reference to FIG. 1, the 
union set agent sends information back to the clustering 
agents, the information comprising updated community pro- 
file information which replaces the preliminary community 

25 profile information. In this way, as described above with 
reference to FIG. 1, different clustering agents will produce 
information agglomerated into the same community profiles. 
In this way, since each community agent is associated with 

30 one community profile, the union set agents preferably 
determine the number of community profiles and the number 
of community agents. 

The community information is then utilized for modifying 
a broadcast schedule (step 200). Typically, the broadcasting 

35 center has a list of items to broadcast, the list being made 
available to a broadcasting agent. It is appreciated that each 
item, sometimes referred to herein as a "document", may 
comprise any article or item typically broadcast by a 

40 broadcaster, such as, for example, a document, an image, a 
video, a computer program, a television program, an update 
to any of the previously listed items, or any other appropriate 
article or item. The agent attempts to prepare, based on 
document information and on community profiles, a broad- 

45 casting program which will maximize the satisfaction of the 
user community. Preferably, this task comprises extracting a 
multimedia document representation based on information 
that accompanies the multimedia document; and scoring all 

50 documents and preparing a broadcast program for each 
community based on the results of the scoring. 

The broadcasting agent preferably determines the simi- 
larity between the community profiles and the document 
collection. Different communities rate the documents differ- 
ently. Therefore, for each document in the document 
collection, the broadcasting agent prepares a vector of scores 
with respect to each community profile. In other words, for 
each document we have a vector of scores where score si is 

gQ the score that the document received by community i. A 
preferable function that the broadcasting agent may use for 
scoring the documents is as follows: 

Scorecommunity _profilc document = 
65 ConunumtyjClasiWei^ x Camniiinity_Subcb3 jWeigh^ x 
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where: 

Cbmmunily_Class_Weightc is the weight of class c 
according lo the community profile; 

Cbmmunity_Subclass_Weights is the weight of subclass 
s of class c of the community profile; 

Cbm_prof_descd is the description field's weight of the 
community profile; 

D is the number of description fields in the description 
vector of the profile; and 

K is the number of terms in the term vector. 
A broadcast program is then chosen for each community. 
Reference is now additionally made to FIG. 5, which is a 
simplified flowchart illustration of a preferred method of 
operation of a portion of step 200 of FIG. 2. The method of 
FIG. 5 comprises preferred method for choosing a broadcast 
program for each community. The method of FIG. 5 is self 
explanatory, except as described below. 

Preferably, after an initial community program is prepared 
for each community, an attempt is made to extend the 
programs to be broadcast by scanning the list of documents 
selected to be broadcast for all users and assigning, to each 
community, additional relevant documents that were 
selected to be broadcast but were not assigned to that 
community program. In this context, a relevant document 
for a community is preferably defined as a document whose 
score for that community exceeds a relevancy threshold, the 
relevancy threshold typically comprising a parameter pre- 
defined by an operator of the system. 

It is appreciated that various features of the invention 
which are, for clarity, described in the contexts of separate 
embodiments may also be provided in combination in a 
single embodiment. Conversely, various features of the 
invention which are, for brevity, described in the context of 
a single embodiment may also be provided separately or in 

any suitable subcombination. 

It will be appreciated by persons skilled in the art that the 45 clustering method. 



wherein the user profile subsystem comprises a plurality 
of clustering agents, each clustering agent being opera- 
lively associated with a subset of user profile agents 
chosen from among the plurality of user profile agents 
and being operative to derive a preliminary community 
profile based on the plurality of user profiles created by 
the subset of user profile agents. 

2. A system according to claim 1 and also comprising at 
least one union set agent in operative communication with at 
least two of said plurality of clustering agents and operative 
to coordinate the operation of said at least two clustering 
agents. 

3. A system according to claim 2 and wherein said union 
set agent is operative to coordinate the operation of said at 

is least two clustering agents by coordinating at least one 
characteristic of the preliminary community profile derived 
by said clustering agents. 

4. A system according to claim 3 and also comprising a 
community profile agent operative to derive a community 
profile from the preliminary community profile. 

5. A system according to claim 1 and wherein said 
integrated user profile comprises at least one community 
profile. 

6. A system according to claim 1 and wherein the subset 
of user profile agents associated with any one of the plurality 
of clustering agents is disjoint from the subset of user profile 
agents associated with any other one of the plurality of 
clustering agents. 

7. A system according to claim 6 and also comprising at 
least one union set agent in operative communication with at 
least two of said plurality of clustering agents and operative 
to coordinate the operation of said at least two clustering 
agents. 

8. A system according to claim 7 and wherein said union 
set agent is operative to coordinate the operation of said at 
least two clustering agents by coordinating at least one 
characteristic of the preliminary community profile derived 
by said clustering agents. 

9. A system according to claim 8 and also comprising a 
community profile agent operative to derive a community 
profile from the preliminary community profile. 

10. A system according to claim 1 and wherein each 
clustering agent is operative to derive the preliminary com- 
munity profile based, at least in part, on a complete link 
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present invention is not limited by what has been particu- 
larly shown and described hereinabove. Rather the scope of 
the invention is defined only by the claims which follow: 
What is claimed is: 

1. A system for collecting user feedback in a data broad- 
casting system, the system for collecting user feedback 
comprising: 

a multiplicity of user profile agents, each user profile 
agent being associated with one of a multiplicity of 
users of the data broadcasting system and being opera- 
tive to create a tree-structured user profile based on 
activity of the one user; 

a user profile subsystem associated with a plurality of user 
profile agents chosen from among the multiplicity of 
user profile agents and operative to derive an integrated 
user profile based on the plurality of user profiles 
created by the plurality of user profile agents; and 

a broadcasting agent operatively associated with a broad- 
cast center of the data broadcasting system and in 
operative communication with the user profile sub- 65 
system and receiving therefrom said integrated user 
profile, 



60 



11. A method for collecting user feedback in a data 
broadcasting system, the method comprising: 

providing a multiplicity of user profile agents, each user 
profile agent being associated with one of a multiplicity 
of users of the data broadcasting system; 

creating, using a plurality of user profile agents from 
among the multiplicity of user profile agents, a plurality 
of tree-structured user profiles based on activity of a 
plurality of users; 

deriving, using a user profile subsystem associated with a 
plurality of user profile agents chosen from among the 
multiplicity of user profile agents, an integrated user 
profile based on the plurality of user profiles created by 
the plurality of user profile agents; and 

utilizing a broadcasting agent operatively associated with 
a broadcast center of the data broadcasting system and 
in operative communication with the user profile sub- 
system and receiving therefrom said integrated user 
profile, 

wherein the user profile subsystem comprises a plurality 
of clustering agents, each clustering agent being opera- 
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tively associated with a subset of user profile agents 
cbosen from among the plurality of user profile agents, 
and 

the deriving step comprises deriving the integrated user 
profile based on the plurality of user profiles created by 5 
the subset of user profile agents. 

12. A method according to claim 11 and wherein the 
deriving step also comprises coordinating the operation of at 
least two of said plurality of clustering agents using at least 
one union set agent in operative communication with at least 10 
two of said plurality of clustering agents. 

13. A method according to claim 12 and also comprising 
said union set agent coordinating the operation of said at 
least two clustering agents by coordinating at least one 
characteristic of a prelirninary community profile derived by 15 
said clustering agents. 

14. A method according to claim U and wherein said 
integrated user profile comprises at least one community 
profile. 

15. A method according to claim 14 and wherein the 20 
deriving step includes a community profile agent deriving 
said at least one community profile from a preliminary 
community profile. 

16. A method according to claim 11 and wherein the 
utilizing step comprises modifying at least one broadcast 25 
program based, at least in part, on the integrated user profile. 

17. A method according to claim 16 and wherein said 
modifying comprises assigning, to a program associated 
with a first community, items scheduled to be broadcast 
according to a program associated with a second community. 30 

18. A method according to claim 17 and wherein said 
assigning comprises assigning based on a measure of rel- 
evancy to the first community. 

19. A method according to claim 11 and wherein the 
subset of user profile agents associated with any one of the 35 
plurality of clustering agents is disjoint from the subset of 
user profile agents associated with any other one of the 
plurality of clustering agents. 

20. A method according to claim 19 and wherein the 
deriving step also comprises coordinating the operation of at 40 
least two of said plurality of clustering agents using at least 
one union set agent in operative communication with at least 
two of said plurality of clustering agents. 



21. A method according to claim 20 and wherein said 
union set agent is operative to coordinate the operation of 
said at least two clustering agents by coordinating at least 
one characteristic of the preliminary community profile 
derived by said clustering agents. 

22. A method according to claim 21 and wherein the 
deriving step includes a community profile agent deriving a 
community profile from the preliminary community profile. 

23. A system according to claim 11 and wherein each 
clustering agent is operative to derive a preliminary com- 
munity profile based, at least in part, on a complete link 
clustering method. 

24. A system for collecting user feedback in a data 
broadcasting system, the system for collecting user feedback 
comprising: 

a multiplicity of user profile agent means for creating a 
user profile, each user profile agent means being asso- 
ciated with one of a multiplicity of users of the data 
broadcasting system and being operative to create a 
tree-structured user profile based on activity of the one 
user; 

means for deriving an integrated user profile, associated 
with a plurality of user profile agent means chosen from 
among the multiplicity of user profile agent means and 
operative to derive an integrated user profile based on 
the plurality of user profiles created by the plurality of 
user profile agent means; and 

broadcasting agent means for receiving the integrated user 
profile, operatively associated with a broadcast center 
of the data broadcasting system and in operative com- 
munication with the means for deriving an integrated 
user profile and receiving therefrom said integrated 
user profile, 

wherein the means for deriving an integrated user profile 
comprises a plurality of clustering agent means, each 
clustering agent means being operatively associated 
with a subset of user profile agent means chosen from 
among the plurality of user profile agent means and 
being operative to derive a preliminary community 
profile based on the plurality of user profiles created by 
the subset of user profile agent means. 
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